Method of providing a multilingual translation device for portable use

ABSTRACT

Portable, real time voice translation systems, and associated methods of use, are provided. The systems include a translation system for use on a single unit, portable computing device and operable for accessing a multilanguage database, selecting a source language from a plurality of source languages and a destination language from a plurality of destination languages, inputting a source phrase, transmitting the source phrase to a speech recognition module, a translation engine, and a template look-up engine for finding the phrase template associated with the destination phrase from among the multiple languages. The spoken translation is then output in the selected destination language. The translation system has a total time between the input of the source phrase and output of the destination phrase that is no slower than 0.010 seconds, and a communications interface operable for communicating with a second computer system.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No13/525,303, filed on Jun. 16, 2012, which is a continuation of U.S.application Ser. No 11/717,903, filed on Mar. 13, 2007, now U.S. Pat. No8,239,184, which claims the benefit of U.S. Provisional Application No.60/782,810, filed Mar. 15, 2006, and U.S. Provisional Application No.60/782,060, filed Mar. 13, 2006; wherein, each of the references ishereby incorporated herein by reference in its entirety.

BACKGROUND

1. Field of the Invention

Portable, real time voice translation systems are provided, the systemsincluding a translation system for use on a single unit, portablecomputing device.

2. Description of the State-of-the-Art

The need for multilingual communication increases daily. Individuals,schools, businesses, and travelers increasingly face situations in whichthey require flexible and reliable language learning solutions andlanguage translation products. For example, between 1990 and 2000, thepopulation in the United States that speaks a language other thanEnglish at home increased by almost 50 percent. And, from aninternational perspective, increased globalization is driving similardemand for multilingual communication.

Powerful market forces underpin the increasing demand for multilinguallanguage learning solutions in education, travel and leisure, training,and entertainment. As of the U.S. Census 2000, at least 15 percent ofthe population speaks a language other than English at home in 15states. This “15/15” demographic likely will grow to “20/20” in the nearterm given the continuing rapid growth in the Spanish-speakingpopulation in the United States. The annual market potential forlanguage learning solutions, considering only these focal states isapproximately $700M, which is a strong indicator of the need forinnovations in this market that replenishes each year with theprevailing school-year calendars.

The No Child Left Behind Act of 2001 (NCLB) provides additional,federally-mandated impetus for more effective language learningsolutions. NCLB requires states to test children in reading and mathevery year in grades 3 through 8. Under NCLB, schools and districts alsoare now accountable for helping students with limited Englishproficiency meet the same challenging academic content and achievementstandards all children are required to meet. The NCLB requirements andobjectives therefore result in a much higher level of visibility andaccountability for language learning, compared to historical norms.

Rapidly changing demographics, NCLB, and the unquestionably highvaluation of language acquisition lead to a strong confluence of marketpressure for viable language learning solutions. In this environment, asignificant problem arises because existing monolingual solutions areforce-fit into multilingual markets.

Existing systems and methods of language learning suffer in that theypresent only one language at a time, and to use the productseffectively, the users must be able to read and/or write. The existingsystems and methods do not relate the spoken word to the written word,and are not fully aligned with curriculum standards. Some of theexisting methods and systems are high-end electronics that are tocomplex and costly for many users.

One of skill in the art of teaching will appreciate multilinguallanguage learning solutions that incorporate the key elements missingfrom existing monolingual language learning tools. Such a solution willinclude a flexible integration of multiple languages; involve speechrecognition and syntheses to make them engaging for a user in the studyof multilingual capabilities; adhere to the necessary student curriculumguidelines; provide a relationship between properly spelled writtentranslations and properly pronounced spoken translations through speechrecognition, translation, and coding technologies; and, will beconducive to language learning, even if the user cannot read or write.Moreover, such a solution will be especially engaging to users from thevery young to the very old, and from the healthy to the infirm, throughits appearance, functionalities, ease of use without supervision, andvoice coding features.

SUMMARY

Portable, real time voice translation systems are provided, the systemsincluding a translation system for use on a single unit, portablecomputing device and, in some embodiments, having a total time betweenthe input of the source phrase and output of the destination phrase thatis no slower than 0.010 seconds, and a communications interface operablefor communicating with a second computer system.

In some embodiments, the system includes a microphone for receivingsound input from a user, wherein, in operation, a portion of the soundinput is associated with a spoken source phrase in a source languageselected from multiple languages. The system includes a multilanguagedatabase that stores a plurality of phrase templates associated with arespective plurality of phrases. A speech recognition module is alsoincluded and is used for converting the spoken source phrase into arecognized source phrase. The system includes a translation engine fortranslating the recognized source phrase in the selected source languageinto a destination phrase in a destination language selected frommultiple languages, wherein the plurality of phrases in themultilanguage database include the destination phrase. A templatelook-up engine is included for finding the phrase template associatedwith the destination phrase from among the multiple languages, and aparameterization module is also included for deriving parameters fromthe sound input and applying the parameters to the phrase templateassociated with the destination phrase. Finally, the system includes aspeaker for outputting the parameterized destination phrase template tothe user as a spoken translation in the selected destination language.

In some embodiments, the system includes a state selector selected froma group consisting of vocabulary content, source language options,destination language options, numeric skills options, translation outputpace, automatic mode, interactive mode, and microphone on/off. In someembodiments, the system includes a state selector for facilitatingselection of a category associated with a plurality of source phrases,wherein the source phrases are stored in the memory of the system, andone of the source phrases is translated into a destination phrase,wherein both the plurality of source phrases and the destination phraseare in languages selected from multiple languages.

The system can sequentially translate a series of spoken source phrasesto provide a real-time translation in the form of a series of spokendestination phrases in the language selected from multiple languages insome embodiments. In some embodiments, the time between the input andoutput of the source phrase in the speech recognition module is noslower that about 2 milliseconds, in the voice coding module is noslower than 3 milliseconds, in the translation engine is no slower thanabout 2 milliseconds, and in the parameterization module is no slowerthan about 3 milliseconds, such that the total time between the input ofthe source phrase and output of the destination phrase is no slower thanabout 0.010 second.

The system can translate source phrases to multiple destinationlanguages in a sequential, simultaneous, or overlapping manner and, insome embodiments, can capture speech parameters of the users voice,apply the captured speech parameters to the phrase template associatedwith the destination language, and use the result to mimic the user'svoice. The captured speech parameters can include the pitch, cadence,and tone of the users voice.

The system can also include a display to show a written form of thesource phrase, a written form of the destination phrase, or both for theuser to relate the spoken phrase to the written phrase. In someembodiments, the system includes a calculation module and the numericskills options include sequential counting, skip counting, addition,subtraction, multiplication, and division in the language selected frommultiple languages.

The system can include a portable, single-unit device, that is (i)designed for use by children of pre-school or elementary school age and(ii) adheres to United States national curriculum guidelines byincluding a combination of teachings comprising math, science, andsocial studies.

In some embodiments, the invention is a method of teaching language ornumeric skills in multiple spoken languages using the systems taughtherein. The method can include setting operational states of the system,wherein the setting includes setting the source language and thedestination language, and optionally includes setting a vocabularydatabase, numeric options, an output pace, automatic mode, interactivemode, or microphone on/off; providing the source phrase to thetranslation engine; and outputting the spoken translation to teachlanguage or numeric skills in the language selected from the multiplelanguages by a user.

These features and more will become apparent to one of skill uponobtaining an understanding of the teachings provided herein.

BRIEF DESCRIPTION OF THE FIGURES

FIG. 1 depicts the general technology platform of a device containingthe computer system for a multilingual teaching of numeric or languageskills according to some embodiments.

FIG. 2 illustrates a processor-memory diagram to describe the majormemory modules processed according to some embodiments.

FIG. 3 is a concept diagram illustrating a device containing thecomputer system for a multilingual teaching of numeric or languageskills according to some embodiments.

FIG. 4 is a diagram of the logic of the system for a multilingualteaching of numeric or language skills according to some embodiments.

FIG. 5 shows the appearance of a device that can incorporate the systemfor a multilingual teaching of numeric or language skills according tosome embodiments.

FIG. 6 is a flowchart illustrating a method of teaching numeric orlanguage skills in multiple spoken languages using the systems taughtherein according to some embodiments.

FIG. 7 is a flowchart illustrating the categories of vocabulary andnumeric skills content selections in the multilanguage and numericdatabases according to some embodiments.

FIGS. 8 a and 8 b illustrate the front and back of a device for childrenthat is designed only for sequential counting or skip counting inmultiple tilanguage and numeric databases according to some embodiments.

FIGS. 8 a and 8 b illustrate the front and back of a device for childrenthat is designed only for sequential counting or skip counting inmultiple languages according to some embodiments.

DETAILED DESCRIPTION

Portable, real time voice translation systems are provided, the systemsincluding a translation system for use on a single unit, portablecomputing device and, in some embodiments, having a total time betweenthe input of the source phrase and output of the destination phrase thatis no slower than 0.010 seconds, and a communications interface operablefor communicating with a second computer system. The teachings include asystem and method for multilingual teaching of numeric or languageskills through an electronic translation of a source phrase to adestination language selected from multiple languages. The electronictranslation can occur as a spoken translation, can be in real-time, andcan mimic the voice of the user of the system. A “phrase” as used hereinis an expression consisting of one or more words, such that the term“word” and “phrase” can be used interchangeably in some embodiments.

FIG. 1 depicts the general technology platform of a device containingthe computer system for a multilingual teaching of numeric or languageskills according to some embodiments. The computer system 100 may be aconventional computer system and includes a computer 105, I/O devices110, and a display device 115. The computer 105 can include a processor120, a communications interface 125, memory 130, display controller 135,non-volatile storage 140, and I/O controller 145. The computer system100 may be coupled to or include the I/O devices 150 and display device155.

The computer 105 interfaces to external systems through thecommunications interface 125, which may include a modem or networkinterface. It will be appreciated that the communications interface 125can be considered to be part of the computer system 100 or a part of thecomputer 105. The communications interface 125 can be an analog modem,isdn modem, cable modem, token ring interface, satellite transmissioninterface (e.g. “direct PC”), or other interfaces for coupling thecomputer system 100 to other computer systems.

The processor 120 may be, for example, a conventional microprocessorsuch as an Intel Pentium microprocessor or Motorola power PCmicroprocessor. The memory 130 is coupled to the processor 120 by a bus.The memory 130 can be dynamic random access memory (DRAM) and can alsoinclude static ram (SRAM). The bus couples the processor 120 to thememory 130, also to the non-volatile storage 140, to the displaycontroller 135, and to the I/O controller 145.

The I/O devices 150 can include a keyboard, disk drives, printers, ascanner, and other input and output devices, including a mouse or otherpointing device. The display controller 136 may control in theconventional manner a display on the display device 155, which can be,for example, a cathode ray tube (CRT) or liquid crystal display (LCD).The display controller 135 and the I/O controller 145 can be implementedwith conventional well known technology.

The non-volatile storage 140 is often a magnetic hard disk, an opticaldisk, or another form of storage for large amounts of data. Some of thisdata is often written, by a direct memory access process, into memory130 during execution of software in the computer 105. One of skill inthe art will immediately recognize that the terms “machine-readablemedium” or “computer-readable medium” includes any type of storagedevice that is accessible by the processor 120 and also encompasses acarrier wave that encodes a data signal.

Objects, methods, inline caches, cache states and other object-orientedcomponents may be stored in the non-volatile storage 140, or writteninto memory 130 during execution of, for example, an object-orientedsoftware program.

The computer system 100 is one example of many possible computer systemswhich have different architectures. For example, personal computersbased on an Intel microprocessor often have multiple buses, one of whichcan be an I/O bus for the peripherals and one that directly connects theprocessor 120 and the memory 130 (often referred to as a memory bus).The buses are connected together through bridge components that performany necessary translation due to differing bus protocols.

Network computers are another type of computer system that can be used.Network computers do not usually include a hard disk or other massstorage, and the executable programs are loaded from a networkconnection into the memory 130 for execution by the processor 120. A WebTV system, which is known in the art, is also considered to be acomputer system according to the present invention, but it may lack someof the features shown in FIG. 1, such as certain input or outputdevices. A typical computer system will usually include at least aprocessor, memory, and a bus coupling the memory to the processor.

In addition, the computer system 100 is controlled by operating systemsoftware which includes a file management system, such as a diskoperating system, which is part of the operating system software. Oneexample of an operating system software with its associated filemanagement system software is the family of operating systems known asWindows® from Microsoft Corporation of Redmond, Wash., and theirassociated file management systems. Another example of operating systemsoftware with its associated file management system software is theLinux operating system and its associated file management system. Thefile management system is typically stored in the non-volatile storage140 and causes the processor 120 to execute the various acts required bythe operating system to input and output data and to store data inmemory, including storing files on the non-volatile storage 140.

FIG. 2 illustrates a processor-memory diagram to describe the majormemory modules processed according to some embodiments. The system 200shown in FIG. 2 contains a processor 205 and a memory 210 (that caninclude non-volatile memory) includes a multilanguage database 215embodied in a computer readable medium including a plurality of phrasetemplates associated with a respective plurality of phrases. The memory210 also contains a speech recognition module 220 embodied in a computerreadable medium for converting the spoken source phrase into arecognized source phrase, as well as a translation engine 225 embodiedin a computer readable medium for translating the recognized sourcephrase in the selected source language into a destination phrase in adestination language selected from multiple languages, wherein theplurality of phrases in the multilanguage database 215 include thedestination phrase. A template look-up engine 230 embodied in a computerreadable medium is included for finding the phrase template associatedwith the destination phrase from among the multiple languages. And, aparameterization module 235 embodied in a computer readable medium isincluded for deriving parameters from the sound input and applying theparameters to the phrase template associated with the destinationphrase. Optionally, the system includes a video display module 240 toshow a written form of the source phrase, a written form of thedestination phrase, or both for the user to relate the spoken phrase tothe written phrase.

The systems taught herein can store any known language or combination oflanguages in the multilanguage database 215. For example, the followinglanguages can be programmed into the systems: French (currently about129 million speakers), Malay-Indonesian(currently about 159 millionspeakers), Portuguese (currently about 191 million speakers), Bengali(currently about 211 million speakers), Arabic (currently about 246million speakers), Russian (currently about 277 million speakers),Spanish (currently about 392 million speakers), Hindustani (currentlyabout 497 million speakers), English (currently about 508 millionspeakers), and Mandarin (currently the most popular with about 1billion+speakers).

In some embodiments, the multilanguage database includes at least threelanguages. In these embodiments, the at least three languages areEnglish, French, and Spanish; English, Japanese, and Mandarin; English,French, and Portuguese; English, Russian, and Mandarin; English,Hindustani, and Japanese; English, Arabic, and Russian; or anycombination desired by the user.

In some embodiments, the systems taught herein accept input speech,perform voice coding, perform speech recognition, display text, obtain atranslation, display error indicators, synthesis speech features,display the translation, and speak the translation. In some embodiments,the systems can operate in an interactive mode or an automatic mode.When operating in an automatic mode the input microphone is disabled.

FIG. 3 is a concept diagram illustrating a device containing thecomputer system for a multilingual teaching of numeric or languageskills according to some embodiments. The device 300 in FIG. 3 containscomponents that can be used in a typical embodiment. In addition to themultilanguage database 215, the speech recognition module 220, thetranslation engine 225, the template look-up engine 230, theparameterization module 235, and the video display module (display) 240shown in FIG. 2, the memory 210 of the device 300 also includes a voicemimic module 310 within the parameterization module 235 to capture thespeech parameters of a users voice and use the captured speechparameters to modify the destination phrase to mimic the users voice,and in some embodiments, this feature is optional. The captured speechparameters are stored for use in an extracted voice parameter database320. In some embodiments, the captured speech parameters include thepitch, cadence, and tone of the users voice. The device 300 includes anoutput module 330 for outputting the destination phrase to the user.

The systems described herein have real-time translation capabilities.For the purposes of the present teaching, a real-time system is one inwhich the correctness of the computations not only depends upon thelogical correctness of the computation but also upon the time at whichthe result is produced. If the timing constraints of the system are notmet, system failure is said to have occurred. A good example of areal-time application is a robot that has to pick up something from aconveyor belt. The piece is moving, and the robot has a small window topick up the object. If the robot is late, the piece won't be thereanymore, and thus the job will have been done incorrectly, even thoughthe robot went to the right place. If the robot is early, the piecewon't be there yet, and the robot may block it. Another example is theservo loops in an airplane when on auto-pilot. The sensors of the planemust continuously supply the control computer with proper measurements.If a measurement is missed, the performance of the airplane can degrade,sometimes to unacceptable levels. Accordingly, the translation system ofthe systems described herein continuously supply phrase translations atthe proper rate and time, thus meeting the timing constraints of thesystem.

In some embodiments, the translation is real-time as long as the inputof the source phrase to be translated aligns with the output of thedestination phrase to produce an accurate and understandable translationat a rate that is substantially similar to the rate that the sourcephrase is input by a user. In some embodiments, the translation isreal-time as long as the output of the destination phrase occurs as anaccurate and understandable translation at a rate that is substantiallysimilar to the rate that the source phrase is input by a user withintime ranging from about 10 milliseconds to about 10 seconds, from about0.01 second to about 5 seconds, from about 0.01 second to about 2seconds, from about 0.01 second to about 1 second, from about 0.01second to about 0.1 second, or any range therein. The slower timeframes, for example, exceeding about 5 seconds, may find usefulness insome embodiments where the user needs more mental processing time of theideas, such as where the user is suffering a pathological condition thataffects mental processes.

The system can sequentially translate a series of spoken source phrasesto provide a real-time translation in the form of a series of spokendestination phrases in the language selected from multiple languages insome embodiments. In some embodiments, the time between the input andoutput of the source phrase in the speech recognition module is noslower that about 2 milliseconds, in the voice coding module is noslower than 3 milliseconds, in the translation engine is no slower thanabout 2 milliseconds, and in the parameterization module is no slowerthan about 3 milliseconds, such that the total time between the input ofthe source phrase and output of the destination phrase is no slower thanabout 0.010 second.

The system can translate source phrases to multiple destinationlanguages in a sequential, simultaneous, or overlapping manner and, insome embodiments, can capture speech parameters of the users voice,apply the captured speech parameters to the phrase template associatedwith the destination language, and use the result to mimic the user'svoice. The captured speech parameters can include the pitch, cadence,and tone of the users voice.

The system can also include a display to show a written form of thesource phrase, a written form of the destination phrase, or both for theuser to relate the spoken phrase to the written phrase. In someembodiments, the system includes a calculation module and the numericskills options include sequential counting, skip counting, addition,subtraction, multiplication, and division in the language selected frommultiple languages.

The system can include a portable, single-unit device that is (i)designed for use by children of pre-school or elementary school age and(ii) adheres to United States national curriculum guidelines byincluding a combination of teachings comprising math, science, andsocial studies. In addition, the written displays provided by the systemare in conformance with the letter formation guidelines.

In some embodiments, the invention is a method of teaching language ornumeric skills in multiple spoken languages using the systems taughtherein. The method can include setting operational states of the system,wherein the setting includes setting the source language and thedestination language, and optionally includes setting a vocabularydatabase, numeric options, an output pace, automatic mode, interactivemode, or microphone on/off; providing the source phrase to thetranslation engine; and outputting the spoken translation to teachlanguage or numeric skills in the language selected from the multiplelanguages by a user.

The input and output of the device 300 is connected to an I/O backplane340, which can be connected to input and output devices through an I/Odevice 350 or directly. In FIG. 3, the I/O device 350 connects to thespeaker (spkr) 352, display 240, and microphone (mic) 354. The sourcelanguage state selector (ss) 341, the destination language stateselector (ds) 342, the vocabulary content state selector (vc) 343, thenumeric state selector (ns) 344, the translation pace state selector(tp) 345, the automatic operation/interactive operation state selector(a/i) 346, and the mute/volume state selector (m/v) 347 are connecteddirectly to the I/O backplane 340. Other features can be added such as,for example, an on/off button, a start button, a speech recognitionindicator, an ear phone input, and the like. In some embodiments, thesystem can turn on and off through motion. In some embodiments, thesystem can have a state selector to select a particular user's voice,such as the mother, father, brother, sister, or even a favorite orrespected teacher of the child. In some embodiments, the system can havea state selector to select a preprogrammed voice that is pleasing to theuser, such as a voice that would make a child think of a bear, a kitten,a monkey, a puppy, a mouse, and the like.

FIG. 4 is a diagram of the logic of the system for a multilingualteaching of numeric or language skills according to some embodiments.The system will start teaching 405 by performing speech recognition 410on a source phrase that is spoken by a user or provided by a teachingprogram in the system. The system will then determine whether the speechis recognized 415. If the speech is not recognized 420, then theteaching will end 425. If the speech is recognized 430, then the systemwill perform a translation 435 on the recognized source phrase. In someembodiments, the translation will be spoken using a voice programmedinto the system 440. In some embodiments, the system will obtain speechparameters from the user's voice and code/mimic 445 the user's voice inorder to speak the translation in the user's voice 450, after which theteaching will end 455. The voice coding/mimic 445 can occursimultaneous, sequentially, or in an overlapping manner with each phraseand with the other operations.

FIG. 5 shows the appearance of a device that can incorporate the systemfor a multilingual teaching of numeric or language skills according tosome embodiments. The device 500 can be in a form that is appealing andeasy to use by a child in order to help engage the child in the learningprocess. Device 500 has the shape of a bear, and the source languagestate selector (ss) 341, the destination language state selector (ds)342, the automatic operation/interactive operation state selector (a/i)346, and the mute/volume state selector (m/v) 347 are positioned on thebear's left and right ears, respectively. The vocabulary content stateselector (vc) 343, the numeric state selector (ns) 344, speaker (spkr)352, display 240, and microphone (mic) 354 can all be positioneddirectly on the bear's face, for example, to give the user the feelingof direct interaction with the bear. A speech recognition indicator 505can be used to show the user whether the users speech was recognized bythe device 500 for translation and should be placed in a position thatis easily seen by the user. The power button 510 and start button 515can be placed anywhere on the device, but like the other buttons andfeatures, should be placed in a position that is easily located by therespected user.

Other state selectors can include, for example, a translation paceselector to adjust the pace of the translation from a real-timetranslation to a slow and more easily assimilated translation pace forease of use by some users. The device 500 will also include a powersupply. In some embodiments, the device 500 will have an internal powersupply, an external power supply, or combination of an internal andexternal power supply. In some embodiments, the device can usebatteries, and in some embodiments, the device can be recharged.

It should be appreciated that the state selectors may be in the form ofdials and buttons that are easy to hold and turn by a child of preschoolage or, for that matter, by any user that has difficulty with handcoordination or strength, such as an older user or a user having anadverse physiological condition whether acute or chronic. Such buttonsand dials can be large and/or prominent in features, highly contrastingin color to adjacent components, and perhaps be shaped or textured forease of gripping. Additionally, it should be appreciated that the shapeand appearance of the device can be changed to meet the interest of anydemographic, whether the user be young, old, teenager, average adult,man, woman, etc. As such, the systems taught herein can be designed tobe appealing and useful to early childhood students, elementary agestudents, older language learners, travelers, business people, andfamilies.

The systems taught herein provide methods of exploring language learningas well as accelerating the acquisition of second or even multiplelanguages. FIG. 6 is a flowchart illustrating a method of teachingnumeric or language skills in multiple spoken languages using thesystems taught herein according to some embodiments. The method includessetting 605 operational states of the system, wherein the setting 605includes setting the source language 606 and the destination language607, and optionally includes setting numeric options 608, a vocabularydatabase 609, an output pace 610, automatic/interactive mode 611, 612,or microphone on/off 613. The method also includes providing 615 thesource phrase to the translation engine and outputting 625 the spokentranslation to teach language or numeric skills in the language selectedfrom the multiple languages by a user.

Educational systems can be mandated to follow curriculum guidelines. Inthe United States, for example, the No Child Left Behind Act requiresstates and school districts to establish particular curriculumguidelines. Nationwide in the United States, students are required tomeet benchmarks for each grade level. The systems taught herein adhereto curriculum guidelines and, in some embodiments, cover numericconcepts from beginning counting to math functions such as, for example,addition, subtraction, multiplication, and division.

General vocabulary skills, for example, can also be taught, in someembodiments, using the systems described herein. Students can masterthese principles using the systems taught herein and then use thisknowledge to master these skills in multiple languages. In someembodiments, the systems taught herein can be useful to preschool andelementary school children, particularly where the systems can bedesigned to adhere to curriculum guidelines. In some embodiments, thesystems taught herein can be useful to high school and college students,particularly if they want to master foreign languages. In someembodiments, the systems taught herein can be useful to older personsthat are either interested in acquiring new skills or want to exercisethese skills.

FIG. 7 is a flowchart illustrating the categories of vocabulary andnumeric skills content selections in the multilanguage and numericdatabases according to some embodiments. The vocabulary and numericskills content selector 700 is a state selector through which a user canselect a set of numeric skills or language skills to learn, wherein thecontent may be designed to adhere to curriculum guidelines as describedherein.

In some embodiments, the vocabulary and numeric skills selector 700includes mathematics 710, science 720, and social studies 730. Themathematics skills can include shapes 712, numbers 714, and functions716. The science skills can include colors 722, body parts 724, days ofthe week 726, and months of the year 728. The social studies can includeclothing 732, family members 734, things in the school 736, and thingsin the home 738. It should be appreciated that other content areas canbe included such as, for example, language arts and reading

In the mathematics 710 content area, the shapes 712, for example, caninclude a triangle, square, circle, rectangle, star, heart, and diamond.The numbers 714, for example, can include numbers from 1-1000, 1-100,1-50, 1-20, 1-10, and any range therein. The numbers can be designed forsequential counting or skip counting, and functions such as addition,subtraction, multiplication, and division can be performed on thenumbers.

In the science 720 content area, the colors 722, for example, caninclude red, green, blue, yellow, brown, orange, pink, purple, black,and white. The body parts 724, for example, can include the head, eyes,nose, mouth, ears, shoulders, arms, fingers, legs, and feet. The days ofthe week 726 and the days of the month 728, of course, are fixed.Although alternate calendars can be contemplated for use in someembodiments.

In the social studies 730 content area, the clothing 732, for example,can include a dress, blouse, skirt, t-shirt, shoes, shirt, pants,sweater, hat, coat, purse, swimsuit, and belt. The family members 734,for example, can include father, mother, brother, sister, grandfather,grandmother, aunt, uncle, and cousin. The things in the school 736, forexample, can include a classroom, cafeteria, library, office, gym,playground, nurse's office, and principal's office. The things in thehome 738, for example, can include a kitchen, living room, dining room,bedroom, bathroom, garage, and yard.

It should be appreciated that the content areas listed above are forexample only, and the totality of the content areas can be larger orsmaller, and each of these areas can be filled with an almost endlessamount of language and numeric teachings. And, for that matter, itshould be appreciated that there is an almost endless variation ofsubcategories that can be implemented for use in the multilingualdatabase.

The systems taught herein can include simple embodiments with limitedteachings. FIGS. 8 a and 8 b illustrate the front and back of a devicefor children that is designed only for sequential counting or skipcounting in multiple languages according to some embodiments. The device800 again has the shape of a bear, but does not accept a spoken sourcephrase and, thus, does not perform speech recognition or voice codingand does not need a microphone (mic) 354, the source language stateselector (ss) 341, the automatic operation/interactive operation stateselector (a/i) 346, speech recognition indicator 505, or the vocabularycontent state selector (vc) 343.

FIG. 8 a shows that the state selectors on the device 800 are few andsimplified. The destination language state selector (ds) 342, andnumeric state selector (ns) 344 are positioned on the bears left andright ears, respectively. The numeric state selector (ns) 344 isactually separated into two different selectors—a counting rangeselector 802 and a skip counting/counting interval selector 806. Speaker(spkr) 352, and display 240, can again all be positioned directly on thebear's face to give the user the feeling of direct interaction with thebear and engage the user in the learning process. The power button 510and start button 515 can again be placed anywhere on the device, butlike the other buttons and features, should be placed in a position thatis easily located by the respected user. FIG. 8 b shows the mute/volumestate selector (m/v) 347 located on the back of the device next to apace selector 808 and a battery compartment 810.

Other state selectors can include, for example, a translation paceselector to adjust the pace of the translation from a real-timetranslation to a slow and more easily assimilated translation pace forease of use by some users. The device 500 will also include a powersupply. In some embodiments, the device 500 will have an internal powersupply, an external power supply, or combination of an internal andexternal power supply. In some embodiments, the device can usebatteries, and in some embodiments, the device can be recharged.

EXAMPLE

The real-time translation capabilities of the systems taught herein aredesigned to have a performance speed that is fast enough to provide afast and engaging real-time translation for a fully functioning systemhaving source language input, recognition, voice coding, translation,and resynthesis. The following table provides process times for themajor steps in the translation:

System Function Time (ms) ASR (Automated Speech Recognition) of utteredsource 2 phrase into system microphone Voice coding (pitch, cadence,tone extraction & buffering) 3 from uttered source phrase Translation ofsource phrase to destination phrase 2 Speech resynthesis (overlay ofextracted pitch, cadence, tone 3 on template destination phrase followedby spoken translation) Total Translation Time 10

It should be appreciated that the methods and displays presented hereinare not inherently related to any particular computer or otherapparatus. Various general purpose systems may be used with programs inaccordance with the teachings herein, or it may prove convenient toconstruct more specialized apparatus to perform the methods of someembodiments. The required structure for a variety of these systems willbe apparent to one of skill given the teachings herein. In addition, thetechniques are not described with reference to any particularprogramming language, and various embodiments may thus be implementedusing a variety of programming languages. Accordingly, the terms andexamples provided above are illustrative only and not intended to belimiting; and, the term “embodiment,” as used herein, means anembodiment that serves to illustrate by way of example and notlimitation.

We claim:
 1. A method of providing a portable, real time voicetranslation, the method comprising: making a translation systemavailable to a user for use on a single unit, portable device having aprocessor and a memory, the translation system having a computer programthat is operable in executing the following functions: accessing amultilanguage database embodied in a non-transitory computer readablestorage medium including a plurality of phrase templates associated witha respective plurality of phrases; selecting a source language from aplurality of source languages and a destination language from aplurality of destination languages; inputting a source phrase;transmitting the source phrase (i) to a speech recognition moduleembodied in a non-transitory computer readable storage medium forconverting the spoken source phrase into a recognized source phrase;(ii) a translation engine embodied in a non-transitory computer readablestorage medium for translating the recognized source phrase in theselected source language into a destination phrase in a destinationlanguage selected from multiple languages, wherein the plurality ofphrases in the multilanguage database include the destination phrase;(iii) a template look-up engine embodied in a non-transitory computerreadable storage medium for finding the phrase template associated withthe destination phrase from among the multiple languages; and,outputting the spoken translation in the selected destination language;the translation system having a total time between the input of thesource phrase and output of the destination phrase that is no slowerthan 0.010 seconds.
 2. The method of claim 1, wherein the executingincludes transmitting the source phrase to (iv) a parameterizationmodule embodied in a non-transitory computer readable storage medium forderiving parameters from the source phrase and applying the parametersto the phrase template associated with the destination phrase.
 3. Themethod of claim 1, wherein the executing includes selecting anoperational state selected from the group consisting of vocabularycontent, source language options, destination language options, numericskills options, translation output pace, and microphone on/off.
 4. Themethod of claim 1, wherein the executing includes sequentiallytranslating a series of input source phrases to provide a real-timetranslation in the form of a series of spoken destination phrases in thelanguage selected from multiple languages, wherein the time between theinput and output of the source phrase in the speech recognition moduleis no slower that about 2 milliseconds, in the voice coding module is noslower than 3 milliseconds, in the translation engine is no slower thanabout 2 milliseconds, and in the parameterization module is no slowerthan about 3 milliseconds, such that the total time between the input ofthe source phrase and output of the destination phrase is no slower than0.010 second.
 5. The method of claim 1, wherein the executing includestranslating a source phrase to multiple destination languages in asequential, simultaneous, or overlapping manner.
 6. The method of claim1, wherein the executing includes capturing speech parameters of theinput source phrase, applying the captured speech parameters to thephrase template associated with the destination language, and using theresult to mimic characteristics of the input source phrase.
 7. Themethod of claim 6, wherein the captured speech parameters include thepitch, cadence, and tone characteristics of the input source phrase. 8.The method of claim 1, wherein the executing includes displaying awritten form of the source phrase, a written form of the destinationphrase, or both.
 9. The method of claim 1, wherein the executingincludes accessing a second computer system through a communicationsinterface.
 10. The method of claim 9, wherein the communicationsinterface includes a satellite transmission interface.
 11. The method ofclaim 1, wherein the choosing includes selecting the source language andthe destination language from the group consisting of French,Malay-Indonesian, Japanese, Portuguese, Bengali, Arabic, Russian,Spanish, Hindustani, English, and Mandarin.
 12. The method of claim 1,wherein the executing includes accessing a plurality of phrase templatesthat represent languages that include at least a combination of English,French, and Spanish; English, Japanese, and Mandarin; English, French,and Portuguese; English, Russian, and Mandarin; English, Hindustani, andJapanese; or, English, Arabic, and Russian.
 13. A method of using aportable, real time voice translation, the method comprising: obtaininga translation system for use on a single unit, portable device having aprocessor and a memory, the translation system having a computer programthat is operable for executing the following functions: accessing amultilanguage database embodied in a non-transitory computer readablestorage medium including a plurality of phrase templates associated witha respective plurality of phrases; selecting a source language from aplurality of source languages and a destination language from aplurality of destination languages; inputting a source phrase;transmitting the source phrase to (i) a speech recognition moduleembodied in a non-transitory computer readable storage medium forconverting the spoken source phrase into a recognized source phrase;(ii) a translation engine embodied in a non-transitory computer readablestorage medium for translating the recognized source phrase in theselected source language into a destination phrase in a destinationlanguage selected from multiple languages, wherein the plurality ofphrases in the multilanguage database include the destination phrase;and, (iii) a template look-up engine embodied in a non-transitorycomputer readable storage medium for finding the phrase templateassociated with the destination phrase from among the multiplelanguages; and, outputting the spoken translation in the selecteddestination language; the translation system having a total time betweenthe input of the source phrase and output of the destination phrase thatis no slower than 0.010 seconds; and, executing the computer program.14. The method of claim 13, wherein the executing includes transmittingthe source phrase to (iv) a parameterization module embodied in anon-transitory computer readable storage medium for deriving parametersfrom the source phrase and applying the parameters to the phrasetemplate associated with the destination phrase.
 15. The method of claim13, wherein the executing includes selecting an operational stateselected from the group consisting of vocabulary content, sourcelanguage options, destination language options, numeric skills options,translation output pace, and microphone on/off.
 16. The method of claim13, wherein the executing includes sequentially translating a series ofinput source phrases to provide a real-time translation in the form of aseries of spoken destination phrases in the language selected frommultiple languages, wherein the time between the input and output of thesource phrase in the speech recognition module is no slower that about 2milliseconds, in the voice coding module is no slower than 3milliseconds, in the translation engine is no slower than about 2milliseconds, and in the parameterization module is no slower than about3 milliseconds, such that the total time between the input of the sourcephrase and output of the destination phrase is no slower than 0.010second.
 17. The method of claim 13, wherein the executing includestranslating a source phrase to multiple destination languages in asequential, simultaneous, or overlapping manner.
 18. The method of claim13, wherein the executing includes capturing speech parameters of theinput source phrase, applying the captured speech parameters to thephrase template associated with the destination language, and using theresult to mimic characteristics of the input source phrase.
 19. Themethod of claim 18, wherein the captured speech parameters include thepitch, cadence, and tone characteristics of the input source phrase. 20.The method of claim 13, wherein the executing includes displaying awritten form of the source phrase, a written form of the destinationphrase, or both.
 21. The method of claim 13, wherein the executingincludes accessing a second computer system through a communicationsinterface.
 22. The method of claim 21, wherein the communicationsinterface includes a satellite transmission interface.
 23. The method ofclaim 13, wherein the choosing includes selecting the source languageand the destination language from the group consisting of French,Malay-Indonesian, Japanese, Portuguese, Bengali, Arabic, Russian,Spanish, Hindustani, English, and Mandarin.
 24. The method of claim 13,wherein the executing includes accessing a plurality of phrase templatesthat represent languages that include at least a combination of English,French, and Spanish; English, Japanese, and Mandarin; English, French,and Portuguese; English, Russian, and Mandarin; English, Hindustani, andJapanese; or, English, Arabic, and Russian.
 25. A portable, real timevoice translation system, comprising: a translation system for use on asingle unit, portable device having a processor and a memory, thetranslation system having a computer program that is operable forexecuting the following functions: accessing a multilanguage databaseembodied in a non-transitory computer readable storage medium includinga plurality of phrase templates associated with a respective pluralityof phrases; selecting a source language from a plurality of sourcelanguages and a destination language from a plurality of destinationlanguages; inputting a source phrase; transmitting the source phrase to(i) a speech recognition module embodied in a non-transitory computerreadable storage medium for converting the spoken source phrase into arecognized source phrase; (ii) a translation engine embodied in anon-transitory computer readable storage medium for translating therecognized source phrase in the selected source language into adestination phrase in a destination language selected from multiplelanguages, wherein the plurality of phrases in the multilanguagedatabase include the destination phrase; and, (iii) a template look-upengine embodied in a non-transitory computer readable storage medium forfinding the phrase template associated with the destination phrase fromamong the multiple languages; and, outputting the spoken translation inthe selected destination language; wherein, the translation system has(i) a total time between the input of the source phrase and output ofthe destination phrase that is no slower than 0.010 seconds; and, (ii) acommunications interface operable for communicating with a secondcomputer system.
 26. The system of claim 25, wherein the executingincludes transmitting the source phrase to (iv) a parameterizationmodule embodied in a non-transitory computer readable storage medium forderiving parameters from the source phrase and applying the parametersto the phrase template associated with the destination phrase.
 27. Thesystem of claim 25, wherein the executing includes selecting anoperational state selected from the group consisting of vocabularycontent, source language options, destination language options, numericskills options, translation output pace, and microphone on/off.
 28. Thesystem of claim 25, wherein the executing includes sequentiallytranslating a series of input source phrases to provide a real-timetranslation in the form of a series of spoken destination phrases in thelanguage selected from multiple languages, wherein the time between theinput and output of the source phrase in the speech recognition moduleis no slower that about 2 milliseconds, in the voice coding module is noslower than 3 milliseconds, in the translation engine is no slower thanabout 2 milliseconds, and in the parameterization module is no slowerthan about 3 milliseconds, such that the total time between the input ofthe source phrase and output of the destination phrase is no slower than0.010 second.
 29. The system of claim 25, wherein the executing includestranslating a source phrase to multiple destination languages in asequential, simultaneous, or overlapping manner.
 30. The system of claim25, wherein the executing includes capturing speech parameters of theinput source phrase, applying the captured speech parameters to thephrase template associated with the destination language, and using theresult to mimic characteristics of the input source phrase.
 31. Thesystem of claim 25, wherein the captured speech parameters include thepitch, cadence, and tone characteristics of the input source phrase. 32.The system of claim 25, wherein the executing includes displaying awritten form of the source phrase, a written form of the destinationphrase, or both.
 33. The system of claim 25, wherein the communicationsinterface includes a satellite transmission interface.
 34. The system ofclaim 25, wherein the choosing includes selecting the source languageand the destination language from the group consisting of French,Malay-Indonesian, Japanese, Portuguese, Bengali, Arabic, Russian,Spanish, Hindustani, English, and Mandarin.
 35. The system of claim 25,wherein the executing includes accessing a plurality of phrase templatesthat represent languages that include at least a combination of English,French, and Spanish; English, Japanese, and Mandarin; English, French,and Portuguese; English, Russian, and Mandarin; English, Hindustani, andJapanese; or, English, Arabic, and Russian.